Analysis of inhomogeneous Markov reward models
نویسندگان
چکیده
منابع مشابه
Analysis of Inhomogeneous Markov Reward Models
The majority of computational methods applied for the analysis of homogeneous Markov reward models (MRMs) are not applicable for the analysis of inhomogeneous MRMs. By the nature of inhomogeneous models only forward differential equations can be used to describe the model behaviour. In this paper we provide forward partial differential equations describing the distribution of reward measures of...
متن کاملEvaluation of Battery Lifetimes using Inhomogeneous Markov Reward Models
The usage of mobile devices like cell phones, navigation systems, or laptop computers, is limited by the lifetime of the included batteries. This lifetimes depends naturally on the rate at which energy is consumed, however, it also depends on the usage pattern of the battery. Continuous drawing of a high current results in an excessive drop of residual capacity. However, during intervals with n...
متن کاملNumerical Analysis of Large Markov Reward Models
First analysis of Markov Reward Models (MRM) resulted in a double transform expression, whose numerical solution is based on the inverse transformations both in time and reward variable domain. Better numerical methods were proposed based on the time domain properties of these models, such as the set of partial differential equation describes the process evolution in time. This paper introduces...
متن کاملInhomogeneous Parsimonious Markov Models
We introduce inhomogeneous parsimonious Markov models for modeling statistical patterns in discrete sequences. These models are based on parsimonious context trees, which are a generalization of context trees, and thus generalize variable order Markov models. We follow a Bayesian approach, consisting of structure and parameter learning. Structure learning is a challenging problem due to an over...
متن کاملMoments analysis in Markov reward models
We analyze the moments of the accumulated reward over the interval (0, t) in a continuous-time Markov chain. We develop a numerical procedure to efficiently compute the normalized moments using the uniformization technique. Our algorithm involves auxiliary quantities whose convergence is analyzed, and for which we provide a probabilistic interpretation. Key-words: Markov models, accumulated rew...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Linear Algebra and its Applications
سال: 2004
ISSN: 0024-3795
DOI: 10.1016/j.laa.2004.02.002